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DETAILED ACTION 

1. Claims 1-21 have been examined. 

Papers Received 

2. Receipt is acknowledged of amendment papers submitted, where the papers 
have been placed of record in the file. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-21 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Parady (5,933,627) in view of Hennessy (Computer Organization and Design). 

5. In regard to claim 1, 

a. Parady discloses a method of handling operations in a multi-threaded 
processing system (figures 1 and 3), comprising: 

i. determining if a stalled operation of a first thread is due to a loading 
of data from a memory device; Column 4, lines 57-59, show that blocking 
loads exist, which stall the operation on a memory access. Column 4, 
lines 59-62 then show that a thread switch occurs on this blocking load 
waiting for data. 

b. Parady does not disclose 
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ii. flushing an instruction from said first thread from a pipeline of said 
processing system when data is to be loaded from said memory device 
before executing said instruction. 

c. Hennessy has shown flushing an instruction from a pipeline of said 
processing system. Page 505 of Hennessy shows that flushing is done in 
various pipeline stages to get rid of invalid instructions on a transfer of control 
such as an exception or branch or transfer of control to another thread as is the 
case in Parady as shown above. 

d. Page 505 of Hennessy shows that transferring control (such as from one 
thread to another in the case of Parady) immediately (by flushing) is desirable so 
that invalid values (from invalid instructions) do not contaminate registers or 
memory locations. This ability to not contaminate registers and memory would 
have motivated one of ordinary skill in the art to modify the design of Parady to 
flush instructions on a transfer of control as taught by Hennessy. With this 
modification in place, Parady would flush instructions stored in the dispatch unit 
(column 3, lines 12-14 show that this unit holds up to four decoded instructions 
for execution) so they are not advanced for execution and contaminate memory 
and registers, as described by Hennessy, when Parady switches (transfers) to 
another flow of control of thread. Parady has further shown in column 4, lines 
45-51 an embodiment where control is immediately transferred back to the 
thread that executed a load when the data is ready before other threads can 
advance. This means that an instruction about to be dispatched would have 
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been flushed on a switch to a critical thread because data is to be loaded for 
execution of an instruction in the critical thread before the flushed instruction can 
execute. 

It would have been obvious to one of ordinary skill in the art to modify the design of 
Parady to use the flushing technique described by Hennessy so that instructions not in 
the flow of control after a thread switch do not contaminate register and memory values. 

6. In regard to claim 2, Parady in view of Hennessy discloses the method of claim 1 , 
as described above, wherein said memory device is system memory coupled to a 
memory bus. Column 3, lines 58-61 show that a case for thread switching that involves 
a memory access would be when an L2 cache (figure 2, elements 80 and 82) misses. It 
is inherent that upon an L2 cache miss, data must be loaded from main memory. 
Figure 2 shows a memory bus, 86, that is coupled to main memory (system memory) 
that is used for getting data on a cache miss. 

7. In regard to claim 3, Parady in view of Hennessy discloses the method of claim 1 , 
as described above, further comprising: marking said instruction as a miss. Column 3, 
lines 58-61 show that a case for thread switching that involves a memory access would 
be when an L2 cache (figure 2, elements 80 and 82) misses. Thus the instruction is 
marked as a miss so the data can be retrieved from main memory. 

8. In regard to claim 4, Parady in view of Hennessy discloses the method of claim 3, 
as described above, further comprising: rescheduling said instruction to be executed in 
said pipeline. Column 4, lines 42-48 show that the thread and the instruction causing 
the switch is rescheduled for execution. 
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9. In regard to claim 5, 

a. Parady discloses a method of handling operations in a multi-threaded 
processing system (figures 1 and 3), comprising: 

i. determining if a stalled operation of a first thread is due to a loading 
of data from a memory device; Column 4, lines 57-59, show that blocking 
loads exist, which stall the operation on a memory access. Column 4, 
lines 59-62 then show that a thread switch occurs on this blocking load 
waiting for data. 

b. Parady does not disclose 

ii. flushing an instruction from said first thread from a pipeline of said 
processing system when data is to be loaded after a predetermined 
number of clock cycles from said memory device before executing said 
instruction. 

c. Hennessy has shown flushing an instruction from a pipeline of said 
processing system. Page 505 of Hennessy shows that flushing is done in 
various pipeline stages to get rid of invalid instructions on a transfer of control 
such as an exception or branch or transfer of control to another thread as is the 
case in Parady as shown above. 

d. Page 505 of Hennessy shows that transferring control (such as from one 
thread to another in the case of Parady) immediately (by flushing) is desirable so 
that invalid values (from invalid instructions) do not contaminate registers or 
memory locations. This ability to not contaminate registers and memory would 
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have motivated one of ordinary skill in the art to modify the design of Parady to 
flush instructions on a transfer of control as taught by Hennessy. With this 
modification in place, Parady would flush instructions stored in the dispatch unit 
(column 3, lines 12-14 show that this unit holds up to four decoded instructions 
for execution) so they are not advanced for execution and contaminate memory 
and registers, as described by Hennessy, when Parady switches (transfers) to 
another flow of control of thread. Parady has further shown in column 4, lines 
45-51 an embodiment where control is immediately transferred back to the 
thread that executed a load when the data is ready before other threads can 
advance. This means that an instruction about to be dispatched would have 
been flushed on a switch to a critical thread because data is to be loaded before 
the flushed instruction can execute. Since a predetermined number of clock 
cycles is not further defined and could be any number, one can apply zero to be 
the predetermined number of clock cycles for instance. Also, there is inherently 
a predetermined number of cycles for loading data from memory. Therefore, the 
flushing is performed when data is to be loaded after a predetermined number of 
clock cycles from memory. 
It would have been obvious to one of ordinary skill in the art to modify the design of 
Parady to use the flushing technique described by Hennessy so that instructions not in 
the flow of control after a thread switch do not contaminate register and memory values. 
10. .In regard to claim 6, Parady in view of Hennessy discloses the method of claim 
5, as described above, wherein said memory device is system memory coupled to a 
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memory bus. Column 3, lines 58-61 show that a case for thread switching that involves 
a memory access would be when an L2 cache (figure 2, elements 80 and 82) misses. It 
is inherent that upon an L2 cache miss, data must be loaded from main memory. 
Figure 2 shows a memory bus, 86, that is coupled to main memory (system memory)- 
that is used for getting data on a cache miss. 

2. In regard to claim 7, Parady in view of Hennessy discloses the method of claim 6, 
as described above, further comprising: marking said instruction as a miss. Column 3, 
lines 58-61 show that a case for thread switching that involves a memory access would 
be when an L2 cache (figure 2, elements 80 and 82) misses. Thus the instruction is 
marked as a miss so the data can be retrieved from main memory. 

3. In regard to claim 8, Parady in view of Hennessy discloses the method of claim 7, 
as described above, further comprising: rescheduling said instruction to be executed in 
said pipeline. Column 4, lines 42-48 show that the thread and the instruction causing 
the switch are rescheduled for execution. 

4. In regard to claim 9, Parady in view of Hennessy discloses the method of claim 8, 
as described above, further comprising: executing said instruction when data is loaded 
from said memory device. Column 4, lines 42-48 show that a thread (and its stalled 
instruction) can be restarted as soon as the memory access is complete. 

5. In regard to claim 10, 

a. Parady discloses a processing system comprising: 

i. a scheduler to pass instructions from a first thread and a second 
thread to an execution pipeline (figure 3, element 28); 
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ii. and pipeline control logic (figure 3, element 112 and figure 1 , 
element 22) coupled to said execution pipeline to determine if a stalled 
execution of a first thread is due to a loading of data from a memory 
device. Column 4, lines 57-59, show that blocking loads exist, which stall 
the operation on a memory access. Column 4, lines 59-62 then show that 
a thread switch occurs on this blocking load waiting for data. Column 3, 
lines 58-61 show that a case for thread switching that involves a memory 
access would be when an L2 cache (figure 2, elements 80 and 82) 
misses. It is inherent that upon an L2 cache miss data must be loaded 
from memory. The thread switch logic will receive a signal from the cache 
showing a cache miss, as shown in figure 3, to show that a memory 
access is required and the thread switch logic will then carry out the flush. 

b. Parady does not explicitly disclose a method to flush an instruction from 
said first thread from said execution pipeline when data is to be loaded from said 
memory device before said instruction can be executed. 

c. Hennessy has shown flushing an instruction from a pipeline of said 
processing system. Page 505 of Hennessy shows that flushing is done in 
various pipeline stages to get rid of invalid instructions on a transfer of control 
such as an exception or branch or transfer of control to another thread as is the 
case in Parady as shown above. 

d. Page 505 of Hennessy shows that transferring control (such as from one 
thread to another in the case of Parady) immediately (by flushing) is desirable so 
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that invalid values (from invalid instructions) do not contaminate registers or 
memory locations. This ability to not contaminate registers and memory would 
have motivated one of ordinary skill in the art to modify the design of Parady to 
flush instructions on a transfer of control as taught by Hennessy. With this 
modification in place, Parady would flush instructions stored in the dispatch unit 
(column 3, lines 12-14 show that this unit holds up to four decoded instructions 
for execution) so they are not advanced for execution and contaminate memory 
and registers, as described by Hennessy, when Parady switches (transfers) to 
another flow of control of thread. Parady has further shown in column 4, lines 
45-51 an embodiment where control is immediately transferred back to the 
thread that executed a load when the data is ready before other threads can 
advance. This means that an instruction about to be dispatched would have 
been flushed on a switch to a critical thread because data is to be loaded before 
the flushed instruction can execute. 
It would have been obvious to one of ordinary skill in the art to modify the design of 
Parady to use the flushing technique described by Hennessy so that instructions not in 
the flow of control after a thread switch do not contaminate register and memory values. 
6. In regard to claim 1 1 , Parady in view of Hennessy discloses the processing 
system of claim 10, as described above, wherein said pipeline control logic is to mark 
said instruction as a miss. As shown above, the pipeline control logic includes the 
cache control. Thus on a cache miss the instruction will be marked as a miss by the 
pipeline control logic. 
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7. In regard to claim 12, Parady in view of Hennessy discloses the processing 
system of claim 10, as described above, further comprising: an exception and 
retirement logic (figure 3, element 112) coupled to said execution pipeline. 

8. In regard to claim 1 3, Parady in view of Hennessy discloses the processing 
system of claim 12, as described above, wherein said instruction marked as a miss is to 
be detected by said exception and retirement logic. As shown above, the pipeline 
control logic includes the cache control. Thus on a cache miss the instruction will be 
marked as a miss by the pipeline control logic. Also as shown above, the thread 
switching logic, receives this cache miss signal, or detects it. Thus the exception and 
retirement logic detects the instruction marked as a miss. 

9. In regard to claim 14, Parady in view of Hennessy discloses the processing 
system of claim 13, as described above, further comprising: a fetch unit (figure 1 , 
element 16) to provide said instruction to said scheduler. 

10. In regard to claim 15, Parady in view of Hennessy discloses the processing 
system of claim 14, as described above, wherein said pipeline control logic is to cause 
said instruction to be executed when data is loaded from said memory device. Column 
4, lines 42-48 show that a thread (and its stalled instruction) can be restarted as soon 
as the memory access is complete. Column 3, lines 54-56 shows that the threads pick 
up where left off upon the switch. Thus the thread control logic and further the pipeline 
control logic must be in control of the event. 

11. In regard to claim 16, 

a. Parady discloses a computing system comprising: 
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i. a memory bus (figure 3, element 1 14) coupled to system memory; 

ii. and a processing system (figures 3 and 1) coupled to said memory 
bus, said processing system including 

(1 ) a scheduler (figure 3, element 28) to pass instructions from 
first thread and second threads to an execution pipeline; 

(2) and pipeline control logic (figure 3, element 112 and figure 1 , 
element 22) coupled to said execution pipeline to determine if a 
stalled execution of a first thread is due to a loading of data from 
system memory. Column 4, lines 57-59, show that blocking loads 
exist, which stall the operation on a memory access. Column 4, 
lines 59-62 then show that a thread switch occurs on this blocking 
load waiting for data. Column 3, lines 58-61 show that a case for 
thread switching that involves a memory access would be when an 
L2 cache (figure 2, elements 80 and 82) misses. It is inherent that 
upon an L2 cache miss data must be loaded from main memory. 
The thread switch logic will receive a signal from the cache showing 
a cache miss, as shown in figure 3, to show that a memory access 
is required and the thread switch logic will then carry out the flush. 

b. Hennessy has shown flushing an instruction from a pipeline of said 
processing system. Page 505 of Hennessy shows that flushing is done in 
various pipeline stages to get rid of invalid instructions on a transfer of control 



Application/Control Number: 09/751 ,762 Page 1 2 

Art Unit: 2183 

such as an exception or branch or transfer of control to another thread as is the 
case in Parady as shown above. 

c. Page 505 of Hennessy shows that transferring control (such as from one 
thread to another in the case of Parady) immediately (by flushing) is desirable so 
that invalid values (from invalid instructions) do not contaminate registers or 
memory locations. This ability to not contaminate registers and memory would 
have motivated one of ordinary skill in the art to modify the design of Parady to 
flush instructions on a transfer of control as taught by Hennessy. With this 
modification in place, Parady would flush instructions stored in the dispatch unit 
(column 3, lines 12-14 show that this unit holds up to four decoded instructions 
for execution) so they are not advanced for execution and contaminate memory 
and registers, as described by Hennessy, when Parady switches (transfers) to 
another flow of control of thread. Parady has further shown in column 4, lines 
45-51 an embodiment where control is immediately transferred back to the 
thread that executed a load when the data is ready before other threads can 
advance. This means that an instruction about to be dispatched would have 
been flushed on a switch to a critical thread because data is to be loaded before 
the flushed instruction can execute. 
It would have been obvious to one of ordinary skill in the art to modify the design of 
Parady to use the flushing technique described by Hennessy so that instructions not in 
the flow of control after a thread switch do not contaminate register and memory values. 
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12. In regard to claim 17, Parady in view of Hennessy discloses the computing 
system of claim 16, as described above, wherein said pipeline control logic is to mark 
said instruction as a miss. As shown above, the pipeline control logic includes the 
cache control. Thus on a cache miss the instruction will be marked as a miss by the 
pipeline control logic. 

13. In regard to claim 18, Parady in view of Hennessy discloses the computing 
system of claim 16 wherein said processing system further includes an exception and 
retirement logic (figure 3, element 112) coupled to said execution pipeline. 

14. In regard to claim 19, Parady in view of Hennessy discloses the computing 
system of claim 18, as described above, wherein said instruction marked as a miss is to 
be detected by said exception and retirement logic. As shown above, the pipeline 
control logic includes the cache control. Thus on a cache miss the instruction will be 
marked as a miss by the pipeline control logic. Also as shown above, the thread 
switching logic, receives this cache miss signal, or detects it. Thus the exception and 
retirement logic detects the instruction marked as a miss. 

1 5. In regard to claim 20, Parady in view of Hennessy discloses the computing 
system of claim 19, as described above, wherein said processing system further 
includes a fetch unit (figure 1, element 16) to provide said instruction to said scheduler. 
In regard to claim 21 , Parady in view of Hennessy discloses the computing system of 
claim 20, as described above, wherein said pipeline control logic is to cause said 
instruction to be executed when data is loaded from said system memory. Column 4, 
lines 42-48 show that a thread (and its stalled instruction) can be restarted as soon as 
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the memory access is complete. Column 3, lines 54-56 shows that the threads pick up 
where left off upon the switch. Thus the thread control logic and further the pipeline 
control logic must be in control of the event. 

Response to Arguments 

16. Applicant's arguments filed 9/17/04 have been fully considered but they are not 
persuasive. 

17. Applicant has argued that the cited references fail to teach, suggest, or disclose 
"...flushing an instruction from said first thread from a pipeline of said processing 
system when data is to be loaded from said memory device before executing said 
instruction" as recited in claim 1. As stated in the rejection for claim 1 , Parady has 
shown in column 4, lines 45-51 an embodiment where control is immediately transferred 
back to the thread that executed a load when the data is ready before other threads can 
advance. This means that an instruction about to be dispatched would have been 
flushed on a switch to a critical thread because data is to be loaded for execution of an 
instruction in the critical thread before the flushed instruction can execute. 

1 8. In response to applicant's argument that the examiner's conclusion of 
obviousness is based upon improper hindsight reasoning, it must be recognized that 
any judgment on obviousness is in a sense necessarily a reconstruction based upon 
hindsight reasoning. But so long as it takes into account only knowledge which was 
within the level of ordinary skill at the time the claimed invention was made, and does 
not include knowledge gleaned only from the applicant's disclosure, such a 
reconstruction is proper. See In re McLaughlin, 443 F.2d 1392, 170 USPQ 209 (CCPA 
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1 971 ). Applicant also argues that there is no motivation to combine but in fact the 
Examiner has specifically pointed to a section of Hennessy showing why one would 
combine the references. This is reproduced as follows: Page 505 of Hennessy shows 
that transferring control (such as from one thread to another in the case of Parady) 
immediately (by flushing) is desirable so that invalid values (from invalid instructions) do 
not contaminate registers or memory locations. This ability to not contaminate registers 
and memory would have motivated one of ordinary skill in the art to modify the design of 
Parady to flush instructions on a transfer of control as taught by Hennessy. With this 
modification in place, Parady would flush instructions stored in the dispatch unit (column 
3, lines 12-14 show that this unit holds up to four decoded instructions for execution) so 
they are not advanced for execution and contaminate memory and registers, as 
described by Hennessy, when Parady switches (transfers) to another flow of control of 
thread. Parady has further shown in column 4, lines 45-51 an embodiment where 
control is immediately transferred back to the thread that executed a load when the data 
is ready before other threads can advance. This means that an instruction about to be 
dispatched would have been flushed on a switch to a critical thread because data is to 
be loaded for execution of an instruction in the critical thread before the flushed 
instruction can execute. It would have been obvious to one of ordinary skill in the art to 
modify the design of Parady to use the flushing technique described by Hennessy so 
that instructions not in the flow of control after a thread switch do not contaminate 
register and memory values. 

Conclusion 
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19. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

20. The following is text cited from 37 CFR 1.111 (c): In amending in reply to a 
rejection of claims in an application or patent under reexamination, the applicant or 
patent owner must clearly point out the patentable novelty which he or she thinks the 
claims present in view of the state of the art disclosed by the references cited or the 
objections made. The applicant or patent owner must also show how the amendments 
avoid such references or objections. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Shane F Gerstl whose telephone number is (571) 272- 
4166. The examiner can normally be reached on M-F 6:45-4:15 (First Friday Off). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Eddie Chan can be reached on (571) 272-4162. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 



Application/Control Number: 09/751,762 



Page 17 



Art Unit: 2183 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Shane F Gerstl 
Examiner 
Art Unit 21 83 , 
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December 21, 2004 



